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(54) Method for forming a digital sharpening/blurring filter 

(57) A method for forming a digital sharpening/blur- 
ring filter, for use in an image processing work station, 
incorporating MTF functions derived from the image 
processing chain, comprising the steps of: 



a) enabling an image processing work station oper- 
ator to select a filter control value from a plurality of 
filter control values that relate to human sharpness 
perception values; 

b) estimating the MTF function of the image 
processing chain; and 

c) forming a digital sharpening/blurring filter, which 
when introduced into the image processing chain, 
changes the overall MTF function in accordance 
with the selected fitter control value so as to imple- 
ment the operator selected change in sharpness. 
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Description 



Cross-Reference to Related Applications 



5 The present application is related to U.S. Application Serial Number 08/576.738. filed Decernber 21 , 1 995. by Ken- 

neth A. Parulski, et al.. and entitled. "Automatic Image Sharpening In An Electronic Imaging System." 

HELD OF THE INVENTION 

10 The invention relates generally to the field of digital image processing, and in particular to an improved digital filter- 
ing technique for sharpening and/or blunring digital images. 

BACKGROUND OF THE INVENTION 

IS Digital image filtering refers to the application of a spatial filter to an image. The effect on the image is controlled by 
the shape of the filter in Fourier space. If the filter accentuates high spatial frequencies, a sharpening effect results. If 
the filter reduces the high frequency content, a blurring effect is obtained. The filter is a function, not a single number. 
We may speak sometimes of the "degree of sharpening** or **degree of blurring,** but there is no general, single-number 
conrelate of these terms. 

20 The overall spatial frequency response of a system or component is described by the Modulation Transfer Function 
(MTF) of Ihe system or connponent. The incorporation of a digital filter into a system has the effect of modifying the over- 
all MTF of the system. 

The shape (response) of tiie filter should depend on frie purpose of the sharpening operation. Often, sharpening is 
done to correct for blunging introduced into the image by a scanner or a printer. In this case, the proper filter shape can 
25 be calculated from the effective blurring of the scanner or printer. 

In many desktop applications, the source of the blurring and the details of the blurring filter are unknown. The cus- 
tomer simply wishes to "make the image sharper." The degree of sharpening is usually a wild guess. The purpose of 
the sharpening may be to correct for a poor image capture or simply for **artistic effect." 

Customers have clearly indicated their desire for a knob in image-editing applications to control sharpness, despite 
30 the logistical problems in using such a control. It has been difficult to provide the customer with an on-screen preview 
of his image which accurately presents its degree of sharpness. It is easy for the customer to specify too nujch sharp- 
ening and regret it when the image is printed. 

The challenge, therefore, is to create a family of filter functions described by a single variable, which meet a specific 
set of needs that is implementable on a digital image processing system. 
35 The creation of a filter is a particular problem in a multi-resolution system with deferred rendering such as a Photo- 
CD system. In such a system, the inrrage is stored at several resolution levels, generally diff^ing by factors of two. The 
customer does not need to be aware of the resolution level being used for any editing, presentation, or printing opera- 
tion ~ this is managed by the software. In many applications the user interface will present to the customer a view of his 
image based on one resolution level and allow the specification of a level of sharpening or blurring. The problem is that 
40 the image may be modified or printed using a different resolution level, and the filtering must carry over in a simple man- 
ner. 

The phrase "deferred rendering" refers to a method of image modification in which customer-defined changes are 
not applied to the image data immediately, but rather are stored in a script, log. or as viewing parameters. These 
changes are associated with the original image data. When the image is displayed or printed, the rendering engine 
45 applies the changes. This method has value if the original image data is stored on a write-once medium or a network 
server far away, or if extensive undo is desired. 

Finally, the selection of a filter is made more complex if the image is part of a composite image. A composite image 
consists of a set of subimages, each of which can be a composite itself. It is not uncommon to associate a first sharp- 
ness increase to an image and a second sharpness increase to the composite image which contains the first image. A 
50 specification of sharpening should behave well under these circumstances. It would be advantageous to have a means 
for combining the sharpening methodologies so that they can be applied once to the subimage in question. This applies 
to blurring operations and to a combination of sharpening and blurring. 

A method for forming filters in the target environment should have the following characteristics: 

55 1 . It should be controlled by a single control value which has a monotonic and predictable effect on the perception 
of sharpness. 

2. It should be relatively fool proof and produce images free of artifacts. 

3. It should also be designed so that applying a first fitter control value, for example, a value of s1. and a second 
filter control value s2, should produce the same effect as a single filter control value s1+s2. 
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4. For a given filter control value it should be easy to form an appropriate fitter for any r^olution of a mutti-resolution 
image. 

5, It should enable the customer to get meaningful sharpening or blurring on the lower resolutions of a multiresolu- 
tion image. 

SUMMARY OF THE INVENTION 



The present invention is directed to overcoming one or more of the problerr^ set forth above. Briefly summarized, 
according to one aspect of the present invention there is provided a method for forming a digital sharpening/blurring f il- 
10 ter. for use in an image processing work station, incorporating MTF functions derived from the image processing chain, 
comprising the steps of: 

a) enabling an image processing work station operator to select a filter control value from a plurality of filter corrtrol 
values that relate to human sharpn^s perception values: 
IS b) estimating the MTF of the image processing chain; and 

c) forming a digital sharpening/blurring fitter, which when introduced into the image processing chain, changes the 
overall MTF in accordance with the selected fitter control value so as to implement the operator selected change in 
sharpness. 

20 This invention pertains to a system in which a digital image is stored as a multiresolution (hierarchical) structure, 
and in which modifications to the image are stored in a script or parameter list. This invention provides a means for the 
user to specify a degree of image sharpening or blurring, in such a manner that the result is independent of which res- 
olution layer is actually used to render the final image. The invention uses changes in system acutance as a measure 
of sharpening or blurring. A digital filter is aeated which produces the desired amount of change. The coefficients of 

25 the digital filter deperid on the resolution layer being used and external parameters which characterize the imaging sys- 
tem. This method provides additional features in an environment where images are composited and edited. 

The invention will also find application in a system in which a digital image is stored at a single resolution, but in 
which the image is resized by the workstation to more than one resolution in the course of image presentation or print- 
ing. 

30 These and other aspects, objects, features, and advantages of the present invention will be more clearly under- 
stood and appreciated from a review of the following detailed description of the prefen-ed embodiments and appended 
claims, and by reference to the acconrpanying drawings. 



Advantageous Effect Of The Invention 

The present invention has the advantage of providing a robust means to specify the degree of sharpening or blur- 
ring, so that the result can be obtained from any level of resolution hierarchy. It permits sequential operations to be tel- 
escoped down to a single operation without loss of accuracy. The method described In the invention requires some 
knowledge of the nature of the imaging system, from input to the hunrran observer. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of a system on which the present invention is implemented: 

45 Fig. 2 is a process flow diagram illustrating the preferred steps of the present method; and 

Fig. 3 is a process flow diagram illustrating in detail the steps used in the calculation of the digital fitter block 20 of 
Fig. 2. 

50 Fig. 4A and 4B illustrate the degradation of a signal by film, and the frequency response of a convolution kernel 
affecting the frequency content of a digital image, respectively, both being represented by MTF. 

Fig. 5 is a graph illustrating aim frequency response from which a convolution kernel can be calculated. 

55 DETAILED DESCRIPTION OF THE INVENTION 

Referring to Fig. 1, the prefered system platform for the present invention is an image processing workstation for 
editing, composition and printing of digital in^ges. The system is comprised of a central processing unit (CPU) 1 0 which 
is adapted to receive digital image data 8 from any source such as a digital camera, scanner, or repository of digital 
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image data. The digital data 8 is displayatrfe as an image on a monitor 1 2 with the system providing the user (operator) 
with a means, such as a keyboard 14. for interfacing with the CPU 10. Sharpening and blurring of the displayed image 
controlled, for example, by keyboard input, mouse input, or other input that performs the same function. Modifications 
to the digital image data result in a modified digital image file 16 that in turn may be used by a printer 18 for printing a 
hard copy of the modified image or ttie file may be stored or transmitted to remote sites 27 for further use. 

The image processing workstation may execute changes in the image under the interactive control of an operator, 
or it may execute a programmed set of imaging operations on one or more images with relatively little operator input. ' 

Referring now to Fig. 2. the incoming digital image data 8 is partitioned to have an image data segment 8A. and a 
segment of additional data 8B. describing tiie circumstance under which the image was captured. A system application 
software 1 1 provides the filter control value (FCV) and other information 1 1 D as to the Intended use of the image, based 
on the characteristics of the printer 18 and the user's input. In almost all system configurations the number of pixels that 
the printer 18 desires to perform its printing function is different from ttie number of pixels available from any of tiie 
image data available in the Image data segment 8A. In particular, among the other information in 11D tiie application 
software 1 1 provides the number of pixels desired by ttie printer 18 and tiie layer of the hierarchy to be i^ed for forming 
the output image. The data from the application software 1 1 along with data 8A and 8B are buffered in buffer 13 for 
future use. 

The filter control value. FCV. and the additional data 8B. and ttie ottier information 1 1D, as to Intended i«e. are 
inputs to the process 20 for calculating (forming) the digital filter 30. The resultant digital filter 30 and the image data 
segment 8A are convolved in operation 40 to form the modified digital image file 16. Once derived, ttie filter control 
value FCV can be stored, transmitted and/or used as the input to the system of Fig. 1 . or any other implementing sys- 
tem independent of or in conjunction witti the image file from which it was derived. 

An idealized approach will now be described for forming the digital filter 30 of ttie present invention. It is desirable 
that tiie filter control value should correlate well with changes in sharpness as perceived by the human eye. Single- 
number metrics for sharpness, generally known as acutance, have been well studied (Rangayyan. Elkadiki). Acutance 
is a positive-definite measure of the capability of a system to reproduce sharpness. Acutance can be computed from 
objective measures of system spatial response. It is usually defined so ttiat equal changes in acutance produce equal 
changes in ttie human perception of sharpness, at all levels of sharpness. A change of one unit in acutance cone- 
sponds to a just-noticeable<lifferenc in sharpness. By using an acutance metric as the filter control value, ttie result of 
the sharpening or blurring operation will be predictable and will be independent of the resolution layer from which ttie 
final image data are calculated. A particular form of acutance. AMT acutance as defined by Edward M. Crane. "Acu- 
tance And Granulance" pages 125-132. SPIE Vol. 310, Image Quality (1981). will be used In the prefen-ed embodiment 
of ttiis Invention. An efficient implementation, utilizing Gaussian techniques, will then t>e described in detail. The calcu- 
lations set forth below are done In the spatial frequency domain. The spatial frequency s is given in cycles/kJixel of the 
relevant digital data. This variable s runs from 0 to 0.5, the Nyquist limit. 

For clarity, the implementation will generally be described In terms of one^Jimensional functions and analysis. It is 
understood ttiat digital image processing operations are implemented in two dimensions. The one-dimensional opera- 
tors may be used in sequence, once In tiie vertical dimension and a second time in ttie horizontal directon; or ttiey may 
be combined via an outer product into a single two-dimensional operator. 

The following Information is required as input to the process 20 to form tiie digital filter 30: 

1 . The composite f^TF values of all of the imaging elements used in tiie formation of the digital data 8A. This com- 
posite MTF will be called MTFc(s). Where s is stated in terms of the highest resolution data 

2. The smoottiing filter MTF values used to prefilter each layer before subsampling. This smoottiing filter MTF will 
be called MTFd(s). The s Is stated In terms of ttie resolution layer being filtered and decimated. 

3. The resampling filter MTF values used to generate ttie desired number of pixels at ttie output (which usually falls 
between the levels in the hierarchy). The resampling filter MTF will be called MTFr(s). The s is stated in terms of 
the resolution level in the hierarchy being resampled. This MTF depends on the resampling factor and the comolex- 
ity of ttie filter. 

4. TTie output MTF values of the printer and its media. This output MTF will be called, MTFp(s). The s Is stated in 
terms of ttie data requested for printing (or display. In which case MTFp(s) is ttie monitor MTF). 

5. The visual MTF values of the human eye. This visual MTF will be called MTFe(s). In this case only, ttie spatial 
frequency s is stated in cycles/degree for the viewing conditions of ttie observer. 

6. The size of the output pixel as seen by the observer. This Is best expressed as tfie angle <|> which Is the angle 
subtended by one pixel at a typical observer's position. 

Additional definitions are also needed prior to the computation of ttie system's total MTFj. An index k counts ttie 
resolution levels of ttie hierarchy with k=0 denoting ttie highest resolution level. is a one dimensional count (height) 
of the number of pixels in level k Np is a one dimensional count (height) of ttie number of pixels requested for forming 
the printed output. 
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The system's total MTF, stated in terms of s for the resolution level K is: 

MTF^(s)=MTF ^) • MTF ^(s) • MTF ,(s) • MTF p(sN ^ p) • MTF ^(sN ^{N p0)) (Eq. 1) 

MTFt(s) is the system MTF without the application of digital filter 30. TTie filter control value FCV. is the change in 
acutance AA that the user has selected. By this method a digital filter 30 with MTF values equal to MTFf(s) is calculated 
and applied to the data of resolution level k. The total system MTF is then 

MTF, -MTF, (Eq. 2) 

Acutance is defined In ternr^ of the system MTF as taught by the put)lication by Crane and as set forth below: 

jMTFj(s)cte _ , 

15 A and B are constants that are defined in Crane's publication. 
After the application of the digital filter 30 the acutance will be: 

fMTF,(s)-MTF,(s)ds 
= • 10 )MTF,(s)ds ^> 

20 Therefore the change of acutance AA will be given by 

jMTF,(s)«MTF,(s)dS ,^ „ 

^=^*'°Sio jMTF.(8)ds ^^-^ 

The present technique relies upon knowing MTFt and adjusting MTFf, so that AA equals the customer requested 
25 value. Having calculated MTFf a spatial digital filter 30 corresponding to MTF( is formed and applied to the lavage data 
8A. 

The implementation described above has two weaknesses. First, it requires detailed MTF data regarding each 
component of the system, which data is generally not available. Second, it requires real time calculations of integrals 
and digital filters. 

30 The preferred implementation avoids these problems by assuming that all of the MTF functions previously set forth 
are Gaussian functions of various widths and by building the sharpening and blurring filters out of Gaussian functions. 
As a result all integrals and filter calculations can be done by experts and the results stored. 
The following form for a Gaussian is used hereinafter: 

35 2 

where z is a constant. The term z controls the width of the Gaussian and has dimensions of pixels-squared. 

Each of the MTF functions input to block 20 will be approximated by a Gaussian function. In particular, recalling that 
40 the spatial frequency a is stated in terms of the resolution layer k: 

MTFc(s) = e^*''. 



45 



\Aniere a is stated in terms of the highest resolution data and a = s/2 ^ 

MTFd(s) = e^< 



Where a is stated in terms of the resolution layer being filtered. The relationship between a and s depends upon the 
choice of filter layer k. For the highest layer k = 0. no decimation takes place, so MTF ^{s) = 1 . For all other layers it is 
50 an acceptable approximation that a = s/2 . This relationship can be expressed simply using the function z(k), which is 
defined to be 0 for k = 0 and 1 for all otiier values of k. For this reason a = z(k)s/2 . 

MTF,(s) = e''°^ 

55 Where a = s 



MTFp(s) = e-P'' 



Where a is stated in terms of the data reguested by the printer and a = (N j^/N )s , 
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MTF^(s) = e-K 

Where a is stated in terms of the angular spatial frequency at the eye of the observer. The relationship between a and 
s IS governed by the size of the image and the distance at which H is viewed. Empirically it has been determin^J that a 
5 viewing distance corresponding to three times the height of the generated image is most often used. Such being the 
case a = 3N ^s . 

Where c. d. r. and p. are values which describe the characteristics of the system. Where y is a measured charac- 
teristc of the human eye and has been determined by Crane to be 

9.1(10 '^)radians^. 
The total system MTF nnay similarly be approximate as: 

MTF^(s) = e-'*'2 

the total Gai^sian width t is thus related to the system characteristics. 

t=c/4 ^z(k)d/4+r+p N ^ ^/N p 2+8.2E-6 N ^ ^ (Eq. 6) 

Based on the preferred implementation, utilizing Gaussian functions, the following family of sharpening and blurring 
filters IS provided. The digital filter 30 is generated using a mixture of fixed elements. Use the formula for shanDeninq 
when AA >0; and use tiie blurring formula for AA < 0. 
For sharpening use: 
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20 



25 MTPVe>_1^ft/l-^-9S^ 
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MTF,(s)=Up(1.e-«") (Eq.7) 

where p and g are free parameters. Our experience tells us that tiiis is a good filter for 0 < p <5. 
The digital filter 30 which con-esponds to the MTF in Eq. 7 is 



F = (l + p)s^pKg 

(Eq, 8) 

35 where I is the identity function and Kg is the kernel corresponding to the value g. For blurring use: 

MTF,(s)=(1-p)e^-9^ -^^pe^-^^ *^'> (Eq. 9) 

where p, g1 and g2 are free parameters with 

40 

g2>g1 and 0<p^1 (Eq ^q) 

The digital filter 30 which con-esponds to tiie MTF of Eq. 9 is 

F=(1-P)Kg,+pKg2 (Eq.11) 

where Kgi is the kernel con-esponding to g1 and Kg2 is the kernel corresponding to the value g2. 

A set of g values is chosen and a table of these values is formed along with the digital filter kernel values corre- 
sponding to the g values and ttie acceptable limits of the parameter p. The g values are chosen so that a wide range of 
50 acutance changes can be achieved for all degrees of overall system sharpness t which will be encountered The limits 
on the parameter p are based on empirical knowledge of the effect of filters on digital images. The table is set fbrtfi 
below: 
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EXAMPLE TABLE FOR BLURRING 


5 


gi 




beta min 


beta max 


kernel size gi 


kernel size g2 








0.1 


5 


0 


1 


3x3 


5x5 


























kernel 
















10 


for g1 


0 


0 


0 














0 


1 


0 














0 


0 


0 










15 




















kernel for g2 


0.0003 


-0.0014 


-0.0141 


-0.0014 


0.0003 










-0.0014 


0.0071 


0.0731 


0.0071 


-0.0014 










-0.0141 


0.0731 


0.7456 


0.0731 


-0.0141 






20 




-0.0014 


0.0071 


0.0731 


0.0071 


-0.0014 










0.0003 


-0.0014 


-0.0141 


-0.0014 


0.0003 
























25 




g2 


beta min 


t>eta max 


kernel size gi 


kernel size g2 








5 


50 


0 


1 


5x5 


7x7 


























kernel for gi 


0.0003 


-0.0014 


-0.0141 


-0.0014 


0.0003 






30 




-0.0014 


0.0071 


0.0731 


0.0071 


-0.0014 










-0.0141 


0.0731 


0.7456 


0.0731 


-0.0141 










-0.0014 


0.0071 


0.0731 


0.0071 


-0.0014 






35 




0.0003 


-0.0014 


-0.0141 


-0.0014 


0.0003 


























kernel for g2 


0.0018 


0.005 


0.009 


0.0109 


0.009 


0.005 


0.0018 


40 




0.005 


0.0133 


0.024 


0.0293 


0.024 


0.0133 


0.005 




0.009 


0.024 


0.0434 


0.0529 


0.0434 


0.024 


0.009 






0.0109 


0.0293 


0.0529 


0.0644 


0.0529 


0.0293 


0.0109 






0.009 


0.024 


0.0434 


0.0529 


0.0434 


0.024 


0.009 


45 




0.005 


0.0133 


0.024 


0.0293 


0.024 


0.0133 


0.005 






0.0018 


0.005 


0.009 


0.0109 


0.009 


0.005 


0.0018 
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EXAMPLE TABLE FOR SHARPENING 


g value 


beta min 


beta nrax 


filter size 










5 


0 


5 


5x5 


























kernel: 


0.0003 


-0.0014 


■0.0141 


-0.0014 


0.0003 








-0.0014 


0.0071 


0.0731 


0.0071 


-0.0014 








-0.0141 


0.0731 


0.7456 


0.0731 


-0.0141 








-0.0014 


0.0071 


0.0731 


0.0071 


-0.0014 








0.0003 


-0.0014 


-0.0141 


-0.0014 


0.0003 






















g value 


beta min 


beta tmin 


filter size 










20 


0 


5 


5x5 


























kernel 


0.003 


0.0135 


0.022 


0.0135 


0.003 








0.0135 


0.06 


0.0979 


0.06 


0.0135 








0.022 


0.0979 


0.1597 


0.0979 


0.022 








0.0135 


0.06 


0.0979 


0.06 


0.0135 








0.003 


0.0135 


0.022 


0.0135 


0.003 






















g value 


beta min 


beta max 


filter size 










50 


0 


5 


7x7 


























kernel 


0.0018 


0.005 


0.009 


0.0109 


0.009 


0.005 


0.0018 




0.005 


0.0133 


0.024 


0.0293 


0.024 


0.0133 


0.005 




0.009 


0.024 


0.0434 


0.0529 


0.0434 


0.024 


0.009 




0.0109 


0.0293 


0.0529 


0.0644 


0.0529 


0.0293 


0.0109 




0.009 


0.024 


0.0434 


0.0529 


0.0434 


0.024 


0.009 




0.005 


0.0133 


0.024 


0.0293 


0.024 


0.0133 


0.005 




0.0018 


0.005 


0.009 


0.0109 


0.009 


0.005 


0.0018 



50 



Given these filters the calculation of the integrals for AA can be done in closed form. Equation 1 2 defines the results 
for sharpening and Equation 13 defines the results for blurring. 

AA=B • log ,o[(l+p).p^] (Eq. 12) 



^ = ^-'^io[0-P)^-P^] (Eq-13) 

Fig. 3 illustrates the process flow 20 for forming the digital filter 30. In process block 21 , the filter control value, FCV, 
other information 1 1 D. and the additional data 8B. are operated upon to calculate tiie Gaussian width of the total system 
MTF. In process block 22 the table entry with the smallest g is selected. Process block 23 uses the value t and the 
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desired AA to calculate the p value required for this g based on either Eq 12 or 13. In decision block 24 the value of p is 
tested against the range of p values stored in the tat>le. tf the value of p is within the range the process proceeds to block 
26. If the value of p is not within the range then the next g value is selected from the table by process block 25 arKi the 
con^esponding p value is again tested for acceptability. Within block 26 the digital filter 30 is formed by appropriate 
5 weighting of the kernels stored in the table and outputted as the digital filter 30 in Rg. 2. 

As an example, consider production of a 4 inch high print on a 300 dpi printer. The image is a hierarchical file start- 
ing with 4096 by 6144 pixels, going down by factors of two. 

Np is 1200; is 4096; assume that c=7. d=10, p=10p r=0. Then: 

10 for the 4k image. k=0: 

t=7+0+1 0(4096/1 200)2+8.2E-6(4096)2=260; 

for the 2k image, k=1 : 

t=2+2+1 0(2048/1 200)2+8.2E-6(2048)2=68; 

15 

for the Ik image, k=2: 

t=0+2+10(1024/1200)246.2E-6(1024)2=18; and 

for the 512 pixel image, k=3: 
20 t=0+2+1 0(51 2/1 200)2+8.2E-6(51 2)2=6. 

Background for Forming Digital niters 

The frequency content of digital images can be affected by convolving the image with an appropriate kernel in the 
25 spatial domain. This could also be accomplished by multiplying the Fourier transform of the digital image with the 
desired frequency response in the spatial frequency domain. The advantage of the former technique over the latter is 
the elimination of the need to Fourier transform potentially large images and inverse transform them after the multipli- 
cation, thus saving compute time and memory. When FIR (finite impulse response) filters are designed to enhance or 
degrade the apparent sharpness of digital images, they are usually designed with monotonic frequency response 
30 curves. It is also customary to normalize the kernels to ensure that the DC term corresponding to a spatial frequency 
of zero has unity response, thereby preventing the kernel from affecting the overall amplitude of the image. The fre- 
quency response of a filter designed to enhance or boost perceived sharpness is greater than unity at spatial frequen- 
cies greater than zero and ^0.5 cycles/sample. The frequency response of a filter designed to degrade or blur perceived 
sharpness is less than unity at spatial frequencies greater than zero and 0.5 cycles/sample. The frequency cone- 
35 Spending to 0.5 cycles/sample represents the highest spatial frequency that can be sampled for a given system and the 
equivalent frequency in units of cycles/mm is dependent upon the sampling resolution of that system. 

Use of the Convolution Theorem 

40 Since it is desirable to filter in tiie spatial domain for the reasons stated above, the convolution theorem is of special 
importance, tf an image denoted as f(x,y) is convolved with a filter denoted as h(x,y), and the resulting modified image 
is denoted as g(x,y), this function can be stated as: 



If the Fourier transforms of f(x,y). h(x,y) and g(x,y) are denoted as F(u,v), H(u.v) and G{u,v) respectively, where x 
and y represent the horizontal and vertical spatial dimensions and u and v represent the horizontal and vertical fre- 
quency dimensions, then the convolution theorem yields the relationship: 



Therefore, the modified image can be obtained via convolution in the spatial domain or via multiplication In the fre- 
quency domain, and the following Fourier pair is defined: 



In digital imaging applications, the trar^form H(u.v) is referred to as tiie transfer function of the process. Its magni- 
tude is referred to as the modulation transfer function, or MTF, and defines the amourrt of response at different frequen- 
cies. In the context of imaging, the MTF or frequency response curve indicates the amount of signal present after 



g(x,y)= h(x,y)®f(x.y) 



45 



50 



G{u,v) = H(u,v)F(u,v) 



55 



h(x.y) <»f(x.y)»H(u,v)F(u,v) 



9 



BNSDOCID; <EP_0788070A2_t_> 



EP0788 070A2 



processing relative to the amount of signal present prior to processing. Film MTF, sinrrply put. is measured by comparing 
the signal that was exposed onto the film to the signal subsequently records! by the f Om as representaJ pictorlally in 
Fig. 4A, In the exanrple. "processing " refers to the physics behind latent image formation in silver halides and the chem- 
ical processing used to 'develop" the recorded image. The Fourier transform of the MTF, H(u,v). yields the function 

5 h(x.y) whidi is refen^ed to as the point spread function. When a convolution kernel that represents the point spread 
function is convolved with a digital image, the frequency content of the original image is altered in a manner defined by 
the Fourier transform of the kernel - its frequency response or MTF. In this example, the "processing" that was men- 
tioned in the above definition of MTF refers to the process of convolving the digital image witii the digital convolution 
kernel. In ttiis case, as in the film MTF case. MTF is defined as tfie frequency response that results from taking the ratio 

10 of the output signal to the original signal. 

Solving for the Kernel Coefffclents 

The task at hand is to determine a convolution kernel from an aim frequency re^nse function. When convolved 
IS witii a digital image, this kerne! will affect the image's frequency content by enhancing or degrading sharpness accord- 
ing to tiie frequency resporree function or MTF Once tiie aim frequency response function has been define, its Fourier 
transform is used to solve for a kernel of coefficients. Such a frequency response curve may look like the cun/e of Fig. 5. 

The arrows in Fig. 5 r^resent three data points in the aim frequency response corre^nding to (0.00,1.0), 
(0.25,0.7). and (0.50,0.1). The curve connecting these points r^resents a spline-fit of the data points. There exists a 
20 kernel of coefficients: 

h(x)=[CBABC] 

which, when convolved witii an image, will change the image's frequency content according to the curve shown in Fig. 
25 4A. In order to determine values for the coefficients A, B, and C. ttie discrete Fourier ti-ansfbrm of the kernel must be 
determined. In order to simplify the matiiematics, only tine one^Jimensional horizontal frequency axis will be consid- 
ered. The discrete Fourier transform is determined according to tiie ^uation: 

^0 H(u)=5;h(x)e''^""^ 

N 



H(u)=H(-u) (|u|^0.5) 

35 

For an even transfer function, that is: 

the general form of the discrete Fourier ti-ansfbrm of h(x) becomes: 

H(u)=A+2Bcos(27cu)+2Ccos(47iu) 

40 

and so on for larger kernels. The number of points defined in the aim frequency response will determine the size of the 
kernel. In ttiis example, tiiree data points were defined so the kernel will have three unique elements and ttie kernel size 
will be 1x5 witti symmetry about tiie center. Denoting each of tiie frequencies in tiie frequency response aim as uq. u^. 
and Us, and ttie responses at each of tiiose frequencies as Rq, Ri . and Rg, matrix inversion can be used to solve for ttie 
45 kernel coefficients A, B, and C in tiie following equation: 









~1 2cos(27cu o)2cos(47cu q)' 


-A- 








1 2cos(27cu i)2cos(47cu 1) 


B 


so 


_R2. 




1 2COS(27CU 2)2COS(47EU 2) 


.C_ 



using matrix inversion. Using tiie frequency response data in Fig. 5, tiie convolution kernel is found to be: 

[-0.0375 0.2250 0.6250 0.2250 -0.0375] 

The coefficients sum to unity so ttie overall contrast of ttie image will not be changed. In this general form, the kernel 
size is dependent upon the number of data points in the frequency response curve. When it is desirable to have kernel 
sizes independent from ttie number of points in the frequency response aim. it is common to interpolate between given 
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frequency response data points and solve for the kernel of desired size using least squares techniques. 

The invention has been described with reference to a preferred embodiment However, it will be appreciated that 
variations arxl modifications can be effected by a person of ordinary skill in the art without departing from the scope of 
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Claims 



1 . A method for forming a digital sharpening/blun-ing filter, for use in an image processing work station, incorporating 
MTF functions derived from the image processing chain, comprising the steps of: 

35 a) enabling an image processing work station operator to select a fitter control value from a plurality of fitter 

control values that relate to human sharpness perception values; 

b) estimating the MTF function of the image processing chain; and 

c) forming a digital sharpening/blurring fitter, which when introduced into the Image processing chain, changes 
the overall MTF function in accordance with the selected filter control value so as to implement the operator 

40 selected change in sharpness. 

2. The method according to Claim 1 wherein the fitter control values represent changes in acutance. 

3. The method according to Claim 1 wherein the fitter control values represent changes in AMT acutance. 

45 

4. The method according to Claim 1 wherein the digital sharpening/blurring filter is formed with the steps of: 

i) providing a precalculated set of kernels; 

ii) selecting a kernel from the set of kernels and calculating a scaling value which provides the operator 
50 selected change in sharpness; and 

iii) combining the kernel and the scaling value to form the digital sharpening/blurring filter. 

5. The method according to Claim 1 wherein the digital sharpening/blurring filter is formed with the steps of: 

55 i) providing a precalculated set of kernels; 

ii) selecting two kernels from the set of kernels and calculating a relative weighting value for each of the kernels 
which provides the operator selected change in sharpness; and 

iii) combining the kernels and the weigtiting values to form the digital sharpening/blurring filter. 
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6. The method according to Claim 4 wherein the kernels are selects to have a Gaussian response. 

7- The method according to Claim 5 wherein the kernels are selected to have a Gaussian response. 

5 8. A method for forming a digital sharpeningA)lurrlng filter, for use in an image processing work station, incorporating 
MTF functions derived from the image processing chain which work station processes digital images having a mul- 
tilevel resolution structure, comprising the steps of: 

a) enabling an image processing work station operator to select a filter control value from a plurality of filter 
control values that represent human sharpness perception values; 

b) estimating the MTF function of the image processing chain; and 

c) forming a digital sharpening/blurring filter for a specific resolution level of the digital image, which when intro- 
duced into the image processing chain, changes the overall MTF function in accordance with the selects filter 
control value so as to implement the operator selected change in sharpness. 



IS 



9. A method for forming a digital sharpening/blurring filter, for use in image processing work statior^. incorporating 
MTF functions derived from the image processing chain, comprising the steps of: 

a) enabling an operator at a first image processing work station to select a filter control value from a plurality of 
20 filter control values that r^resent human sharpness perception values; 

b) estimating the MTF function of the image processing chain; and 

c) forming a digital sharpening/blun-ing filter at a second image processing work station, which when intro- 
duced into the image processing chain, changes the overall MTF function in accordance with the selected filter 
control value so as to implement the operator selected change in sharpness. 



2S 



10. A method for forming a digital sharpeningAjlurring filter, for use in an image processing work station, incorporating 
MTF functions derived from the image processing chain, comprising the steps of: 

a) selecting a filter control value from a plurality of filter control values that relate to human sharpness Derceo- 
30 tion values; 

b) estimating the MTF function of the image processing chain; and 

c) forming a digital sharpening/blurring filter, which when introduced into the image processing chain, changes 
the overall MTF function in accordance with the selected filter control value so as to implement the selected 
change in sharpness. 
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